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PERFORMANCE  CHARACTERISTICS 
OF  PASSIVE  COHERENCE  ESTIMATORS 


INTRODUCTION 

Passive  coherent  processing  is  commonly  used  to  detect  a  target  signal  present  at  two  sensors 
remotely  located  in  a  transmission  medium.  Typically,  the  target  signal  at  each  sensor  is  contami¬ 
nated  by  broadband  noise,  and  the  received  signals  are  correlated  over  a  two-dimensional  ambiguity 
surface  to  compensate  for  time-register  and  doppler  differences  in  the  received  target  signal.  Thresh¬ 
olding  is  employed  to  detect  when  and  where  (over  the  ambiguity  surface)  the  correlator  output 
exceeds  a  preset  value.  Performance  measures  for  such  a  system  include  the  detection  versus  false- 
alarm  probabilities  as  a  function  of  the  input  signal -to -noise  ratios. 

Modem  coherence  processors,  which  are  well  suited  for  passive  detection,  include  the 
magnitude-squared  coherence  (MSC)  estimator  [1-3]  and  the  normalized  correlation  envelope 
(NCE)  estimator  [4] .  These  processors  are  normalized  and  provide  an  output  signal  whose  statistics, 
for  uncorrelated  signals,  are  essentially  independent  of  the  input  signal  levels.  Thus,  the  false-alarm 
rate  for  a  given  threshold  is  effectively  stabilized.  For  a  given  threshold  (false-alarm  probability), 
detection  is  optimum  when  the  target  signal  energy  required  for  detection  is  minimized. 

Until  recently,  the  general  opinion  of  researchers  was  that  detection  was  optimum  when  the 
processor  bandwidth  was  matched  to  the  spectral  bandwidth  of  the  target  signal.  There  is  good 
reason  to  suspect  this  to  be  true,  since  this  condition  maximizes  the  ratio  of  the  mean-peak  correla¬ 
tion  output  to  the  standard  deviation  of  the  output  when  the  signals  are  uncorrelated  [5] .  Band- 
widths  greater  than  the  signal  bandwidth,  moreover,  increase  the  noise  power  without  increasing 
the  signal  power.  (Such  a  condition  is  termed  “overcontainment”  of  the  target  signal  and  is 
employed  to  ensure  containing  the  desired  signal  within  the  processor  bandwidth  when  its  band¬ 
width  is  unknown  or  highly  nonstationary.)  However,  recent  studies  by  Joseph  LaPointe  demon¬ 
strate  that  overcontainment  can  actually  improve  the  detection  sensitivity  of  the  MSC  estimator 
under  certain  conditions  [6,7].  These  conditions  occur  when  the  number  of  degrees  of  freedom  (or 
time-bandwidth  product)  of  the  target  signal  is  less  than  a  critical  value,  which  depends  on  the  input 
gignal-to-noise  ratios.  In  this  report,  detection  performance  is  studied  in  a  general  context,  and  opti¬ 
mum  design  parameters  are  determined  for  both  the  NCE  and  the  MSC  estimators  when  they  are 
employed  as  passive  target-signature  detectors. 


SIGNAL  DESCRIPTION  AND  REPRESENTATION 

In  a  passive  detection  system,  the  processor  input  usually  consists  of  signals  from  two  remote 
sensors.  In  general,  the  signals  from  the  two  sensors  are  uncorrelated  until  the  delay  time  and 
doppler  difference  of  a  common  narrowband  target  signal  u(f)  are  properly  compensated.  After 
compensation,  the  two  signal  inputs  may  be  expressed  as 
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»l(0“«l«(0  +  Hl(0  (la) 

and 

82(0  =  fl2w(t)  +  n2(f)*  (lb) 

where  nx  (t)  and  n2(t)  are  the  uncorrelated  noise-background  signals  of  the  two  channels.  For  pur¬ 
poses  of  this  report,  it  is  assumed  that  the  power  spectral  density  of  the  target  signal  u(t)  is  uni¬ 
formly  distributed  and  confined  within  a  narrow  bandwidth  of  W  Hz,  the  power  spectral  density 
of  the  noise  signals  is  uniformly  distributed  over  the  processor  bandwidth  of  B  Hz,  and  the  target 
signal  is  completely  contained  within  B  (W<B).  The  resultant  power  and  crosspower  of  the  two 
input  signals  are 


<  sf  (t )>  =  (1  +  (2a) 

<sf  (t)>  =  (l  +  r2/p2)<n|(t)>i  (2b) 

and 

<Sl(t)s2(t)>  yfTn  \  (f)><  rtf  (*)>,  (2c) 


where 


r2  =  af  <u2(t)>/<  n\  (£)> 


(3a) 


and 


p2  =  a\<  n\  (f)>/a|  <  ni  (0>*  (3b) 

In  the  above  relations,  r2  is  the  input  signal-to-noise  power  ratio  of  the  one  channel  and  p2  is  the 
ratio  of  the  input  signal-to-noise  power  ratios  in  the  two  channels.  (This  notation  will  prove  con¬ 
venient  in  the  analysis  to  follow.) 


Normalized  Signal  Correlation 

The  normalized  correlation  (or  peak  coherence)  of  the  input  signals  is  defined  as  the  ratio  of 
the  peak  signal  crosspower  to  the  geometric  mean  of  the  input  signal  power  [4] .  Thus,  from 
Eq.  (2),  the  normalized  correlation  of  the  signals  sx  (t)  and  s2(0  is 

r2 

7(r;p)=— :  — '  (4) 

V(1  +r2)(p2  +r2) 

The  normalization  bounds  the  peak  coherence  between  the  limits  0  and  1,  regardless  of  the  input 
signal  levels,  thus  providing  a  measure  of  the  correlation  coefficient.  The  problem  of  thresholding 
for  a  given  false-alarm  rate  is  thereby  greatly  simplified. 
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Correlation  Output  Signal-to-Background  Ratio 

In  the  past,  a  measure  of  performance  in  detection  processors  has  been  the  ratio  of  the  mean- 
peak  signal  crosspower  to  the  standard  deviation  of  the  signal  crosspower  when  the  signals  are 
uncorrelated  [5] .  This  measure  is  the  correlation  output  signal-to-background  ratio  and  is  expressed 
as  a  function  of  the  input  $ignal-to-noise  ratios.  In  the  case  under  consideration,  Eq.  (2c)  gives  the 
mean-peak  crosspower.  The  uncorrelated  signal  crosspower  is  evidenced  over  remote  areas  of  the 
two-dimensional  ambiguity  surface  where  the  time  and/or  doppler  differences  between  the  target 
signal  inputs  are  uncompensated.  In  this  area,  the  variance  of  the  input  signal  crosspower  may  be 
shown  to  be  [8] 


a 


2 

o 


<  n2  (Q><  n\  (t)> 
2BTp2 


(l  +  r2)(p2  +  r2) 


(5) 


where  T  is  the  integration  time  of  the  correlation  processor.  Consequently,  from  Eqs.  (2c)  and  (5), 
the  mean-peak  output  signal-to-background  ratio  may  be  written  as 


<s1(f)«2(f)> 


V2BT  r2 


V(l  +  r2)(p2  +  r2)  +  —  l)  r4 

VWT  y 


yi  ♦(!-!),» 

The  above  ratio  can  vary  only  between  the  limits  0  and  v/2 WT. 


(6) 


Effect  of  Processor  Bandwidth  B 

The  effect  of  the  processor  bandwidth  B  {W<B)  on  the  above  relations  is  not  immediately 
apparent,  since  the  input  signal-to-noise  power  ratio  r2  is  a  function  of  B.  To  study  the  effect  of  the 
processor  bandwidth,  the  variable  is  defined  as  the  input  signal-to-noise  power  spectral  density 
ratio.  Thus,  r2  *  /B  and  Eq.  (6)  becomes 


<MW  r° _  (7) 

aO  =  / - 4 - 

fBp2+(l+p2)r2  4  Iff. 

It  is  obvious,  then,  that  the  mean -peak  output  signal-to-background  ratio  maximizes  for  B  equal  to 
W,  except  when  p  is  zero.  In  this  case,  however,  the  correlation  processor  becomes  a  perfect 
matched  filter  (since  the  signal-to-noise  ratio  of  the  second  input  is  infinity),  and  the  noiseless 
signal  input  serves  as  an  optimum  (or  matched)  filter  for  the  processor. 

From  the  above  analysis,  it  would  appear  that  the  optimum  choice  for  the  processor  band¬ 
width  would  be  to  make  it  equal  to  the  target  signal  bandwidth.  However,  the  story  is  not  yet 
complete.  The  crux  of  the  optimization  problem  centers  around  minimizing  the  expected  target 
signal  energy  required  to  equal  or  exceed  the  threshold  for  a  given  false-alarm  probability.  One 
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may  readily  perceive,  from  Eq.  (5),  that  the  variance  of  the  unnormalized  correlation  output  is 
nonstationary  and  varies  with  the  power  of  the  two  input  signals.  Consequently,  some  form  of 
normalization  of  the  processor  output  is  required  if  the  false-alarm  rate  is  to  remain  fixed  for 
a  given  threshold  level  of  the  processor  output.  The  following  analysis  is  therefore  directed  to  the 
performance  of  the  class  of  normalized  coherence  estimators  whose  idealized  performance  is  given 
in  Eq.  (4). 


CORRELATION  ESTIMATORS 

The  correlation  estimators  to  be  studied  are  the  normalized  correlation  envelope  (NCE)  esti¬ 
mator  and  the  magnitude-squared  coherence  (MSC)  estimator.  Both  compute  the  ratio  of  the 
average  signal  crosspower  to  the  geometric  mean  of  the  two  averaged  signal  powers,  over  an  integra¬ 
tion  time  interval  T.  The  crosspower  and  signal-power  averages  are  computed  after  the  two  input 
signals  have  been  bandpass  filtered  (bandwidth  B  Hz)  and  basebanded  [4] .  Thus  the  computed  ratio 
is  a  measure  of  the  normalized  correlation  envelope  of  the  two  signals  and  constitutes  the  sample 
statistic  for  the  NCE  estimator.  The  sample  statistic  for  the  MSC  estimator  is  simply  the  square  of 
the  sample  statistic  for  the  NCE  estimator.  In  practice,  both  estimators  employ  the  sectionalized 
Fourier  transform  to  accomplish  the  operations  of  bandpass  filtering,  basebanding,  and  signal 
sampling  [4] .  As  a  consequence,  complex  numbers  are  involved  in  the  processing,  and  only  the 
magnitude  of  the  resulting  ratio  is  used  in  the  sample  statistics.  (This  is  the  reason  for  the  termi¬ 
nology  “magnitude-squared”  in  the  case  of  the  MSC  estimator,  and  “magnitude  coherence”  as  the 
NCE  estimator  is  sometimes  called.)  Details  of  these  estimators  may  be  found  in  Ref.  4. 


Expected  Value  of  the  Sample  Statistic 

Both  the  NCE  estimator  and  the  MSC  estimator  are  biased  estimators.  Letting  y  designate 
the  sample  statistic  for  the  NCE  estimator,  its  expected  or  mean  value  may  therefore  be  written  as 

<f>  =  7  +  0lf  (8a) 

where  the  bias  term  is  a  function  of  both  7  2  and  the  processor  time -bandwidth  product  BT. 

The  square  of  the  mean  is  simply 


<7>2  =  y2  +  +  h).  (8b) 

The  sample  statistic  for  the  MSC  estimator  is  the  square  of  the  sample  statistic  for  the  NCE  esti¬ 
mator  or  7  2 .  The  expected  value  for  this  estimator  is 


<f2>=72+0,  (8c) 

where  0  represents  the  bias  of  this  estimator.  Since,  however,  the  expected  value  of  the  MSC  esti¬ 
mator  is  the  second  moment  of  the  NCE  statistic,  it  is  a  simple  matter  to  show  that  Eq.  (8b)  may  be 
written  as 


<7>2  =  72+^_a2,  (8d) 

where  ay2  is  the  variance  of  the  NCE  statistic.  A  generalized  form  for  Eqs.  (8c)  and  (8d)  may  there¬ 
fore  be  written  as  y2  +  g(72 ;  BT),  where  g(y2JiT)  is  equal  to  0  in  the  case  of  the  MSC  estimator  or 
0  —a  2  in  the  case  of  the  NCE  estimator.  Since  0  is  always  positive,  g(y2  \BT)  will  be  smaller  for  the 
NCE  estimator. 
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False-Alarm  Probability 

Although  the  probability  density  functions  for  the  two  sample  statistics  are  highly  compli¬ 
cated  in  the  general  case  [9] ,  when  7  is  equal  to  zero  (input  signals  are  uncorrelated)  the  probability 
density  functions  reduce  to 


py{ 7)  =  2(M  -l)f(l  -72)m-2, 


(9a) 


and 

p, 2(f  2)  =  (M  — 1)(1  —  y2)M~2,  (9b) 

where  M  -  BT  +  1  is  the  number  of  degrees  of  freedom  of  the  estimator  [10] .  In  either  case,  the 
probability  that  the  sample  statistic  exceeds  a  threshold  level  yQ  (producing  a  false  target  or  alarm) 
is 


THE  DETECTION  PROBLEM  AND  SOLUTION  OUTLINE 
Detection  Criterion 

Equating  the  expected  value  of  the  coherence  estimator  to  the  threshold  level  for  a  given 
probability  of  false  alarm  provides  a  reasonable  criterion  for  target  detection.  Thus,  from 
Eqs.  (8)  and  (9) 


y2*g(t2\BT)  =  -il  (10a) 

is  to  be  solved  for  the  input  sign al-to -noise  power  spectral  density  ratio  rc  as  a  function  of  the  false- 
alarm  probability  PF  T  ,  the  processor  parameter  BT,  and  the  signal  parameter  p.  Unfortunately,  a 
straightforward  solution  to  Eq.  (10a)  is  impractical  due  to  the  complexity  of  the  bias  term 
g(72  -JBT).  On  the  other  hand,  for  false-slarm  probabilities  of  interest,  the  influence  of  the  bias  term 
will  be  to  cause  only  a  second -order  effect  on  the  solution  to  the  equation.  This  allows  a  novel 
approach  to  the  solution  to  be  taken. 

To  begin,  it  may  be  observed  that  the  influence  of  the  bias  term  is  to  reduce  the  value  of  >2 
required  for  the  left-hand  side  of  Eq.  (10a)  to  equal  .  It  therefore  proves  convenient  to  let 

l 

y2  =  y2  -  g(y2;BT)  =  1-PBT,  (10b) 
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where  P  is  some  probability  greater  than  PF  T  that  is  dependent  on  Pp/p  ,  BT ,  and  the  bias  function 
g(y2  ;BT)*  The  procedure  is  first  to  solve  the  detection  criterion  in  terms  of  the  interim  probability 
P,  and  then  to  determine  the  relationship  between  the  probability  parameters  P  and  PFT  as  a 
function  of  the  processor  parameter  BT.  It  turns  out  that  this  will  involve  only  minor  variations  in 
the  ordinate  and  abscissa  scales  of  the  original  solution.  This  approach  is  equivalent  to  first  solving 
the  problem  by  ignoring  the  bias  of  the  estimator,  and  then  demonstrating  the  changes  in  the  solu¬ 
tion  required  to  accommodate  the  influence  of  the  bias  on  the  resulting  solution. 


Relationship  Between  P{x\PFT  )  andP/^y 


From  Eqs.  (9d)  and  (10b)  the  relationship  between  the  probability  function  P  and  the  false- 
alarm  probability  Ppp.  is 


Pfj.  =  -P87  [l-J°  BT  g{l-PBT-,BT)\ 

(11a) 

or 

r  --1-  (  J_  \1 

logPFX  =  logP  +  BT  log  [l-P  BT  g[l-PBT-,BT) J. 

(lib) 

Letting 

x  =  BT/(— log  P), 

(11c) 

and  noting  that 

p57^  (o.i)T, 

(lid) 

relation  (lib)  becomes 

log PFT  =  logp|l  —  X  log  [l  —  Z(x;logP)]  |  , 

(lie) 

where 

Z(x;logP)  =  HFg  ^-(o.l^-slogpj. 

(Ilf) 

Although  quite  complicated,  it  is  possible  to  solve  the  implicit  function  in  the  variable  logP,  as  a 
function  of  x  and  1  ogPF  F  (see  the  appendix). 


DETECTION  PERFORMANCE  RELATIONS 
General  Solution  of  Detection  Performance 


From  Eqs.  (4)  and  (10b)  the  criterion  for  detection  in  terms  of  the  input  signal-to-noise 
ratios  becomes 


(1  +r2)(p2  +r2)’ 
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or 

r4_(p-CT'_l)[(1_p2)r2+p2]>  o.  (12b) 

This  is  a  simple  quadratic  inequality  in  r2  and  can  readily  be  solved.  Letting  =  Br2  represent  the 
input  signal -to -noise  power  spectral  density  ratio,  the  general  detection  solution  becomes 

r2T 

—  =  f2x 

(-log  P) 

>  a(p)xQ(x)  [l  +  +  b(p)/Q(x)  ]  ,  (12c) 

where 

is  the  signal -to -noise  power  spectral  density  ratio, 
r2  is  the  signal-to-noise  power  ratio  in  the  bandwidth  B, 

T  is  the  processor  integration  time  in  seconds, 

a(p)  =  (1  +  p2)/2, 

6(p)=  [2p/(l+p2)]2, 

*  =  BT/(— log  P) , 

and 

1  JL_ 

Q(x)  =  P  57  -Is  10*  -1. 

For  convenience  in  modifying  the  ordinate  and  abscissa  scales  to  accommodate  the  effects  of 
the  processor  bias,  given  in  Eq.  (10b),  a  bias-correcting  function  JR(*;Pfx)  is  defined  as 


R(x;Pft)  =  logPFT/logP.  (13a) 

Thus  the  abscissa  scale  may  be  expressed  as 

x  =  R(x;PF'T.)BTH-logPF'Tm).  (13b) 

Figure  1  shows  the  family  of  curves  represented  by  Eq.  (12c);  the  two  axes  are  expressed  in 
terms  of  the  bias-correcting  function  R(x;PFj*).  The  derivation  of  this  function  for  both  the  NCE 
and  the  MSC  estimators  is  given  in  the  appendix.  Figures  2  and  3  show  families  of  curves  for  the 
function  and  ten  times  its  logarithm.  These  curves  may  be  used  to  determine  specific  numeric  values 
along  the  two  scales  shown  in  Fig.  1 .  (An  example  providing  the  BT  values  along  the  abscissa  for 
Pf  Tt  equal  to  10"  4 ,  when  using  the  NCE  estimator,  is  given  at  the  top  of  Fig.  1.)  It  may  be  noticed 
that  the  influence  of  the  bias  on  the  family  of  curves  (Fig.  1)  is  to  shift  the  curves  to  the  left  and 
downward  (relative  to  the  scales  when  R  is  assumed  equal  to  one),  with  the  shift  being  larger  at  the 
higher  values  of  the  abscissa  scale.  This  shift  in  the  curves  decreases  with  decreasing  false -alarm 
probability  and  is  relatively  small  for  false -alarm  probabilities  less  than  about  10~3.  It  may  also  be 
noted  that  the  shift  of  both  scales  for  the  MSC  estimator  is  approximately  twice  that  for  the  NCE 
estimator  (for  a  given  value  of  x  and  Pjp.r.)- 
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The  family  of  curves  (Fig.  1 )  illustrates  that  there  is  a  defined  minimum,  or  optimum  value  of 
BT  (noted  by  the  small  circles  and  joined  with  a  dashed  curve),  except  when  p  =  0  (-°°  dB).  Thus, 
when  the  target  signal  bandwidth  W  is  less  than  the  indicated  minimum  value  for  BT  divided  by  the 
integration  time  T,  optimum  detection  performance  is  achieved  by  overcontainment  of  the  target 
signal  for  a  given  false-alarm  probability.  It  may  also  be  observed  that  the  gradient  of  detection 
sensitivity  (in  dB)  is  rather  moderate  in  the  neighborhood  of  the  optimum  BT.  This  means  that  one 
could  employ  a  value  BT  which  is  4  times  (or  more)  the  optimum  value  without  suffering  a  severe 
penalty  in  detection  sensitivity.  These  results  are  in  agreement  with  those  of  LaPointe  in  his  study 
on  the  effects  of  signal  overcontainment  on  cross-correlation  detection  performance  [7] . 


BT  (PrT  ■  10~4)  FOR  THE  NCE  ESTIMATOR 


Fig.  1  —  Detection  performance  characteristics  for  normalized  coherence  estimators  as  a  function  of  the 
signal  and  processor  parameters.  The  bias  correcting  function  R(x;PFT  )  and  10  times  its  logarithm,  for 
the  NCE  and  MSC  estimators,  are  displayed  in  Figs.  2  and  3.  (The  abscissa  scale,  displayed  at  the  top  of  the 
graph,  is  BT  for  the  NCE  estimator  when  the  false-alarm  probability  is  10~4.)  The  variable  r2  is  the  input 
signal -to -noise  power  spectral  density  ratio,  and  r2  is  the  in-band  signal -to -noise  power  ratio.  The  parameter 
p2  is  the  ratio  of  the  two  input  signal -to -noise  power  ratios.  The  dashed  curve  is  the  locus  of  detection 
minima. 
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Detection  Performance  in  Terms  of  the  Mean  Signal-to-Noise 
Ratio  of  the  Two  Input  Channels 

The  family  of  curves  shown  in  Fig.  1  defines  the  detection  performance  of  the  correlation 
estimator  in  terms  of  the  signal -to -noise  ratio  on  one  of  the  two  signal  inputs.  Since  any  excess  of 
signal -to -noise  ratio  in  one  of  the  two  channels  can  partially  offset  a  depletion  of  signal -to -noise 
ratio  in  the  second  channel,  it  is  interesting  to  study  the  degree  to  which  an  excess  of  signal-to- 
noise  ratio  in  the  one  channel  proves  advantageous  in  target  detection.  The  standard  for  comparison 
is  that  where  the  two  input  signal-to-noise  ratios  are  equal  (p  =  1  or  0  dB). 

The  measure  of  relevance  is  the  geometric  mean  of  the  two  input  signal-to-noise  ratios,  or  the 
arithmetic  mean  of  the  signal-to-noise  ratios  when  expressed  in  decibels.  For  r(x\p)  and  p  expressed 
in  decibels,  the  arithmetic  mean  signal-to-noise  ratio  of  the  two  input  channels,  expressed  in 
decibels,  is 


rm(x;p)  =  [r(x\p)  +  r(x;-p)]/2 
=  r(x;p)-p/2. 


(14) 


The  family  of  curves  in  Fig.  1  has  been  recomputed  in  terms  of  the  mean  input  signal-to-noise 
ratio  and  is  displayed  in  Fig.  4.  These  curves  demonstrate  that  when  the  two  input  signal-to-noise 
ratios  are  unequal,  more  total  signal  power  (or  energy)  is  required  for  detection  than  when  the  two 
input  signal-to-noise  ratios  are  equal.  The  increase  in  signal  power  is  less  at  the  higher  values  of  x 
(large  BT),  but  becomes  increasingly  larger  as  the  signal-to-noise  ratio  imbalance  (absolute  value  of 
p)  becomes  larger.  It  is  evident  that  any  signal-to-noise  ratio  excess  (amount  greater  than  that 
required  for  p  =  0  dB)  in  the  one  input  channel  is  partially  offset  by  a  decrease  in  the  signal-to-noise 
ratio  of  the  second  channel  (required  for  detection).  This  utility  of  the  signal-to-noise  ratio  excess 
(in  the  second  channel)  is  explicitly  plotted  in  Fig.  5  as  a  function  of  the  signal-to-noise  ratio  excess 
and  the  value  of  jc.  These  curves  demonstrate  that  initially  the  trade-off  in  signal-to-noise  ratio  is 
nearly  one-to-one.  That  is,  the  detection  criterion  can  be  based  on  the  mean  signal-to-noise  ratio  of 
the  two  input  channels,  provided  the  signal-to-noise  ratio  imbalance  is  sufficiently  small.  However, 
when  the  imbalance  in  the  input  signal-to-noise  ratios  becomes  large,  the  utility  of  the  signal  excess 
in  the  one  channel  decreases  and  eventually  saturates  (see  Fig.  5).  At  this  point,  the  correlation 
processor  is  functioning  as  a  matched  filter  or  replica  correlator,  and  no  further  improvement  in 
processing  gain  can  be  expected. 
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Fig.  2  —  Curves  of  the  bias-correcting  function  R(x\PF  T  )  and  10  times  its  logarithm  for  the  NCE 
estimator.  These  curves  may  be  used  to  convert  the  scales  in  Fig.  1  to  relevant  numeric  values.  (See 
the  appendix  for  derivation  of  the  curves.) 
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Fig.  3  —  Curves  of  the  bias -correcting  function  R(x ;  PFT  )  and  10  times  its  logarithm  for 
the  MSC  estimator.  These  curves  may  be  used  to  convert  the  scales  in  Fig.  1  to  relevant 
numeric  values.  (See  the  appendix  for  derivation  of  the  curves.) 
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BT  l^T»10*4)  FOR  THE  NCE  ESTIMATOR 


Fig.  4  —  Detection  performance  characteristics  for  normalized  coherence  estimators  in  terms  of  the 
geometric  mean  of  the  two  input  signal  -to-noise  power  ratios.  The  bias -correcting  function  R{x>PF  T  ) 
and  10  times  its  logarithm,  for  the  NCE  and  MSC  estimators,  are  displayed  in  Figs.  2  and  3.  (The  abscissa 
scale,  displayed  at  the  top  of  the  graph,  is  BT  for  the  NCE  estimator  when  the  false-alarm  probability  is 
10-4.)  The  variable  r2m  is  the  geometric  mean  of  the  two  input  signal -to -noise  power  spectral  density 
ratios,  and  is  the  geometric  mean  of  the  two  in-band  signal-to-noise  power  ratios.  The  parameter 
p2  is  the  ratio  of  the  two  input  signal-to-noise  power  ratios.  The  dashed  curve  is  the  locus  of  detection 
minima. 
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Fig.  5  Curves  illustrating  the  utility  of  an  excess  of  signal -to -noise  ratio  in  one  channel  in  lower¬ 
ing  the  signal -to -noise  ratio,  required  for  detection,  of  the  second  channel.  The  dB  measure,  in 
either  case,  is  referenced  to  that  required  for  detection  when  the  signal -to -noise  ratios  of  both 
channels  are  equal  (p  =  0  dB). 


Detection  Performance  Topology 

Figure  6  displays  another  way  of  illustrating  the  detection  performance  of  the  coherence 
estimator.  Here  the  topological  contours  give  the  performance  degradation  (in  0.5  dB  steps)  relative 
to  the  optimum  point  in  the  x ,  p  plane  (located  at  x  =  5.04,  p  *  0  dB).  (These  contours  do  not 
include  the  bias  function  term  10  log  R  given  in  Figs.  2  or  3.  However,  for  most  false-alarm  prob¬ 
abilities  of  interest,  this  bias  function  term  does  not  significantly  change  the  contours.)  The  dashed 
curve  represents  the  locus  of  points  of  minimum  coherence  degradation  along  the  p  axis.  Since 
W<B,  the  illustrated  topology  is  valid  only  over  the  area  where  WKBT.  For  a  given  W  and  7\  a 
horizontal  line  should  be  drawn  at  the  appropriate  ordinate  value  on  Fig.  6,  and  only  values  above 
this  line  are  valid.  Below  this  line,  the  degradation  would  be  more  severe  than  that  shown  due  to  the 
loss  in  target  signal  energy  resulting  from  the  decreased  processor  bandwidth. 
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OPTIMUM  DESIGN  CONSIDERATIONS 
Parameter  Selection  Criteria 

In  practical  applications,  the  user  of  a  correlation  processor  is  interested  in  achieving  detection 
at  the  lowest  total  input  signal  power  consistent  with  other  considerations  outside  of  his  control.  A 
study  of  Fig.  4  reveals  that  the  ordinate  scale  is  dependent  on  the  integration  time  T ,  the  false- 
alarm  probability  Pf  p  ,  the  bias-correcting  function  R(jc  ;  Ppp  ),  and  the  power  spectral  density 
r$ .  The  influence  of  the  bias-correcting  function  is  relatively  insignificant.  And,  although  the 
detection  sensitivity  can  be  enhanced  by  operating  at  a  high  false-alarm  probability,  the  choice  here 
is  limited  by  the  number  of  false  alarms  that  one  is  willing  to  accept  in  a  given  application.  A  more 
important  consideration  is  the  integration  time  of  the  processor.  One  may  readily  observe  that  each 
doubling  of  the  integration  time  will  lower  the  ordinate  scale  by  3  dB.  This  rate  is  sufficient  to 
offset  the  maximum  1.5  dB  per  octave  rise  in  the  curves  (Figs.  1  and  4)  which  may  result  from  the 
increased  value  otBT.  Consequently,  the  system  designer  should  use  as  long  an  integration  time  as  is 
practical  from  other  considerations.  For  many  applications,  however,  the  maximum  useful  integra¬ 
tion  time  is  limited  by  factors  outside  of  the  control  of  the  system  designer.  In  this  situation,  one 
should  compute  the  value  for  WT  and  draw  a  lower  boundary  line  at  the  appropriate  x  value  on 
Figs.  1,4,  and  5.  When  this  boundary  is  above  the  minimum  value  of  the  relevant  curve  it  is  the 
optimum  operating  point  of  the  processor.  That  is,  the  processor  bandwidth  B  should  be  set  equal 
to  the  signal  bandwidth  W .  On  the  other  hand,  if  the  lower  boundary  is  below  the  minimum  value  of 
the  curve,  optimum  detection  performance  is  achieved  when  the  processor  bandwidth  B  is  increased 
to  the  point  where  BT  on  the  appropriate  curve  (for  the  parameter  p )  indicates  a  minimum. 


Detection  Performance  Sensitivity  to  Parameter  Selection 

To  select  the  processor  bandwidth  B  for  optimum  detection,  in  an  absolute  sense,  requires 
knowledge  of  the  input  signal  parameters  W  and  p.  Unfortunately,  for  many  applications  the  signal 
bandwidth  W  is  generally  not  known  precisely.  And  the  ratio  of  the  input  signal -to-noise  ratios  is  an 
uncontrollable  parameter  which  can  vary  over  wide  limits.  Under  these  circumstances,  the  sensitiv¬ 
ity  of  the  detection  performance  to  variations  in  the  parameter  BT,  about  the  optimum  value  for  a 
given  p,  becomes  important.  In  theory,  it  is  possible  to  choose  a  value  of  BT  which  optimizes  the 
detection  performance  in  a  statistical  sense.  However,  to  carry  out  the  analysis  requires  a  priori 
knowledge  of  the  relevant  statistics  for  p  and  IV  over  the  ensemble  of  values  (for  these  parameters) 
to  be  expected  in  a  given  application.  Unfortunately,  these  statistics  are  generally  not  known  with 
precision,  which  increases  the  importance  of  the  detection  sensitivity  to  the  selection  of  an  appro¬ 
priate  value  for  the  parameter  BT. 

To  demonstrate  the  sensitivity  of  detection  performance  to  the  selection  of  BT,  the  data  in 
Fig.  6  have  been  redrawn  to  reflect  the  degradation  in  detection  performance  resulting  from 
choosing  suboptimal  values  of  BT  for  a  given  value  of  p .  Figure  7  illustrates  the  resulting  curves.  The 
curve  entitled  Locus  of  Detection  Minima  reflects  the  optimum  value  of  BT  as  a  function  of  the 
signal  parameter  p.  The  dashed  curves  (on  either  side  of  this  curve)  reflect  values  of  BT  which 
result  in  the  given  performance  degradation  from  that  which  is  optimum.  These  curves  demonstrate 
that  the  detection  performance  is  not  highly  sensitive  to  the  choice  of  the  parameter  BT,  and  the 
sensitivity  decreases  as  |  p|  becomes  larger.  For  example,  the  variation  in  the  selection  of  BT  at 
p  =  0  dB  can  be  4.8  to  1  and  at  p  =  ±18  dB  can  be  12.5  to  1,  without  suffering  •  }oss  in  detection 
performance  greater  than  0.5  dB.  This  insensitivity  to  detection  performance  is  also  evident  in  a 
study  of  the  curves  shown  in  Figs.  1,  4,  and  6  (from  which  the  curves  in  Fig.  7  are  derived). 
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Fig.  7  —  Curves  reflecting  the  sensitivity  in  peak  coherence  performance  to 
the  deviation  of  the  processor  parameter  BT  from  its  optimum  value.  The 
curves  are  applicable  only  for  processor  bandwidths  B  equal  to  or  greater 
than  the  signal  bandwidth. 


To  use  the  curves  (Fig.  7),  one  should  first  determine  the  maximum  value  of  signal  bandwidth 
W  that  can  reasonably  be  expected.  A  horizontal  line  should  then  be  drawn  at  the  value  WT  for  the 
chosen  PF  T  and  estimator  to  be  employed.  This  horizontal  line,  in  conjunction  with  the  Locus  of 
Detection  Minima ,  serves  as  a  lower  bound  in  the  selection  of  the  processor  parameter  BT.  One  may 
then  estimate  the  range  of  values  for  the  parameter  p  over  which  detection  may  be  expected  in  the 
given  application.  The  optimum  selection  for  BT  lies  somewhere  in  the  neighborhood  of  the  lower 
bound  over  the  indicated  range  of  p.  The  precise  selection  of  BT  depends  on  the  probability  densi¬ 
ties  adjudged  for  the  statistical  variables  p  and  W.  In  any  event,  it  can  be  observed  that  consider¬ 
able  latitude  is  available  in  the  selection  of  BT  without  seriously  degrading  the  detection  perform¬ 
ance  of  the  coherence  estimator.  As  an  example,  if  WT  occurs  at  x  =  10  (40  for  the  NCE  estimator 
operating  at  PFx  ~  10~4 )  or  below,  and  p  can  range  over  ±30  dB,  then  BT  can  be  between  40  and 
72  (for  the  indicated  estimator)  without  serious  performance  degradation. 

Some  caution  is  warranted  in  the  application  of  the  above  procedures.  Recall  that  the 
preceding  analysis  is  based  on  a  flat  noise  or  interference  signal  spectrum  over  the  spectral  range  in 
which  B  is  varied.  This  is  a  reasonable  assumption  for  many  applications  of  narrowband  detection 
processors.  However,  it  does  not  consider  the  existence  of  narrowband  interfering  signals  which  can 
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radically  degrade  the  input  signal-to-noise  (interference)  ratio  when  they  fall  within  the  processor 
bandwidth  B.  Consequently,  when  there  is  a  large  number  of  narrowband  interfering  signals  distrib¬ 
uted  in  the  spectral  region  of  the  anticipated  target  signal,  this  fact  would  favor  a  lower -than  - 
otherwise  choice  for  BT  (to  reduce  the  probability  of  a  strong  interfering  signal  from  falling  within 
the  processor  bandwidth  B).  The  selection  of  processor  design  parameters,  which  are  optimum  in  a 
true  operational  sense,  does  require  a  fair  amount  of  human  experience  and  judgment  in  most 
practical  applications. 


CONCLUSIONS 

1.  Optimum  performance  of  passive  coherence  estimators  is  not  necessarily  realized  by  match¬ 
ing  the  processor  bandwidth  to  the  bandwidth  of  the  target  signal,  even  when  the  target  signal  band¬ 
width  is  known  a  priori.  In  many  practical  applications,  particularly  when  the  time-bandwidth 
product  of  the  target  signal  is  severely  limited,  detection  performance  is  enhanced  by  overcontain¬ 
ment  of  the  target  signal  within  the  processor  bandwidth. 

2.  The  optimum  processor  bandwidth  and  the  resulting  detection  performance  are  functions 
of  the  correlator  integration  time,  the  ratio  of  the  two  input  signal-to-noise  ratios,  and  the  false- 
alarm  probability  threshold.  For  a  fixed  integration  time  and  false-alarm  probability,  the  optimum 
processor  bandwidth  Increases  as  the  ratio  of  the  two  input  signal-to-noise  ratios  deviates  from 

1  (0  dB).  However,  the  degradation  in  detection  performance  to  deviations  of  the  processor  band¬ 
width  from  its  optimum  value  becomes  decreasingly  less  (see  Fig.  7). 

3.  For  a  given  processor  time -bandwidth  product  and  false-alarm  probability,  the  minimum 
total  signal  power  required  for  detection  is  realized  when  two  input  signal-to-noise  ratios  are  equal 
(see  Fig.  4).  As  the  ratio  of  the  two  input  signal-to-noise  ratios  deviates  from  1  (0  dB),  greater  total 
input  signal  power  is  required  for  detection.  However,  the  required  power  increase  becomes  less  as 
the  time-bandwidth  product  of  the  process  becomes  greater.  The  efficiency  of  the  trade-off  in  the 
two  input  signal-to-noise  ratios,  as  a  function  of  the  processor  time-bandwidth  product  and  the 
signal-to-noise  ratio  excess  in  the  one  input  channel,  is  given  in  Fig.  5. 

4.  The  relations  developed  in  this  analysis  are  based  on  a  uniform  noise  or  interference 
spectrum  over  the  range  of  processor  bandwidth s  employed.  Therefore,  caution  is  required  when 
there  exists  a  large  number  of  narrowband  interfering  signals  which  are  likely  to  fall  within  the 
selected  processor  bandwidth.  This  particular  situation  would  favor  a  lower-than -otherwise  choice 
for  the  processor  bandwidth  to  reduce  the  probability  of  a  strong  interfering  signal  from  degrading 
the  detection  sensitivity  of  the  processor. 
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Appendix 

BIAS-CORRECTING  FUNCTION  R  (x ;  PFF ) 


The  relationship  between  the  interim  probability  P  and  the  false-alarm  probability  PFtx. 
is  given  in  Eq.  (11)  as 


logPFr ■  =  log?  jl  —  x  log  [1  —  Z(*;logP)]  (  , 


(A-la) 


where 


Z(*;logP)  •  10xg)l 


;-x  log  P 


(A-lb) 


and  where  g(y2;BT)  =  0  in  the  case  of  the  MSC  estimator  or  g(y2  \  BT)  =  0  —  Oy2  in  the  case  of  the 
NCE  estimator.  It  is  desired  to  solve  the  implicit  function  (A-la)  for  P(x ;  PFF)  and  compute  the 
bias-correcting  function 


R(x;PFT)  =  logPF  T  /log  [P(x;PFT)] .  (A-lc) 

This  requires  explicit  knowledge  of  the  bias  function  0  and  the  variance  o. y2 . 


The  Function  R(x\PF  T  )  for  the  MSC  Estimator 

Both  the  bias  and  the  variance  functions  of  concern  involve  rather  complicated  forms  of  the 
generalized  hypergeometric  function.  However,  Nuttall  and  Carter  have  derived  rather  precise 
approximations  to  these  functions  which  will  be  quite  suitable  for  the  purpose  of  this  report  [Al] . 
The  details  of  the  approximations  and  their  precision  may  be  obtained  from  Ref.  Al . 

Expressed  in  the  terminology  of  this  report,  the  approximation  for  the  bias  function  0 
becomes 


(»♦**&,)•  (A'2*' 

Letting p  -  —  log  P  *  log  (1/P),  the  function  Z(x\ log  P)  for  the  MSC  estimator  is,  from  Eq.  (A-lb), 

(A-2b) 

By  use  of  this  function  in  Eq.  (A-la),  the  implicit  function  has  been  solved  on  the  computer  for 
values  oiPFT  ranging  from  10-1  to  10*10.  Graphs  of  the  function  P(x;PFy)  and  10  times  its 
logarithm,  for  the  MSC  estimator,  are  plotted  in  Fig.  3. 
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When  x  is  very  large,  2(jc; log  P)  approximates  1/px,  and  it  is  easy  to  show  that 


Lim.  R(x;\ogP) 
x~+°° 


(A*2c) 


The  Function  R(x;PF  T  )  for  the  NCE  Estimator 

Expressed  in  the  terminology  of  this  report,  the  approximation  for  the  variance  a ^  provided 
by  Nuttall  and  Carter  [Al]  becomes 


where 


°72 


- (1  -72)2  1  — y2 

2(BT  -1)|_  BT+1 


(1-72)2  x  A 
(BT+  1)2  1  +5^2 


(A-3a) 


A  =  0.571(BT)2  -  0.608 BT  -  1.939 
B  =  0.752BT  — 2.508 
C  =  0.221(BT)2  ~  1J21&BT—  1.439. 

Again  lettering  p  =  —log  P  =  log  (1/P),  with  a  little  algebraic  manipulation  the  function 
Z(x;  logP)  may  be  shown  to  be 


Z(*;logP)  =  +°-1)X 


2  (px  + 1) 


1  + 


px  —1  pzxz—  1 


(o.i  rh^px) 


]| 


(A-3b) 


where 


AxCpjc)  *  0.071375(px)2  —  0.076px  —0.242375 
f2(px)  =  0.221(px)2  -  0.466/w  -  2.947 
f2(px)  ~  0.442(px)2  —  1.684px  —  5.386 

U(px)  =  0.221(px)2  —  1.218/mc  —  1.439. 

By  use  of  this  function  in  Eq.  (A-la),  the  implicit  function  has  been  solved  on  the  computer  for 
values  of  PFT  ranging  from  10-1  to  10*10 .  Graphs  of  the  function  R(x ;  PFT )  and  10  times  its 
logarithm,  for  the  NCE  estimator,  are  plotted  in  Fig.  2. 
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The  solution  of  Z(x\PF  T  )  when  x  is  very  large  is  not  simple  in  the  case  of  the  NCE  estimator. 
However,  by  employing  LTfospitaTs  Rule  it  can  be  shown  that  for  large  x 


Z(x;logP)~-i 
2px 

Consequently,  for  p  sufficiently  large  (Ppp  sufficiently  small)  a  suitable  approximation  for  the 
limit  of  R(x;Ppp)  as  x  becomes  very  large  is 


_ 0.571 

I  1.1717p2 +  1.7315p 


+  1 


(A-3c) 


Lta.B(,;P,.T.)»  [l  ♦  2  lQg°g/~]~‘  <A-M) 

A  study  of  the  curves  in  Figs.  1  and  2  reveals  that  the  value  of  R (jc ;  PF  T  )  for  the  NCE 
estimator  is  approximately  equal  to  one-half  times  one  plus  the  value  of  R(x;Pp  f  )  for  the  MSC 
estimator,  over  much  of  the  range  of  x  and  PF.T.- 

Scale  Values  for  PF  T  =  10-4 

To  demonstrate  the  influence  of  the  bias-correcting  function  on  the  scales  of  the  graphs  pre¬ 
sented  in  the  report,  the  values  of  x  and  10  log  R(x ;  PFT  )  have  been  computed  for  a  false-alarm 
probability  PF  T  of  10'4  and  BT  ranging  from  4  to  3000.  Table  A-l  gives  the  results.  The  first 
column  displays  the  values  of  the  abscissa  x  for  an  ideal  unbiased  estimator;  that  is,  when 
R(x \Pp.T.)  this  case,  jc  is  simply  equal  to  BT  divided  by  log  (1/Pp.r.)*  no  sca*e  correc¬ 

tion  is  required.  The  corresponding  values  of  jc  for  the  biased  estimators  may  then  be  compared 
with  those  of  the  ideal  estimator  to  assess  the  influence  of  the  bias  on  the  scales.  Note  that  the 
influence  of  the  bias  increases  with  the  abscissa  variable  x  out  to  about  x  =  20,  after  which  it  levels 
off.  The  overall  effect  of  the  bias  (relative  to  the  ideal  unbiased  estimator)  is  to  slightly  shift  the 
detection-performance  curves  in  Figs.  1  and  4  to  the  left  and  downward.  The  resulting  influence  on 
the  scales  can  generally  be  ignored  for  false-alarm  probabilities  less  than  about  10~4 .  Scale  markings 
of  BT,  for  the  NCE  estimator  and  PF  T  =  10"4 ,  have  been  included  on  the  detection -performance 
curves  presented  in  the  report. 
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Table  A-l  —  Abscissa  Values  x  and  10  log  [R(x;PpT .)! ,  as  a  Function  of  BT, 
for  the  Coherence  Estimators  when  PF  T  =  10“4 
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